CONTROLLING MULTIPARTICLE SYSTEM ON A LINE. I 
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Abstract. We study a classical multiparticle system (such as Toda 
lattice) whose dynamics we intend to control by forces applied to few 
particles of the system. Various problem settings, typical for control the- 
ory are posed for this model; among those: studying accessibility and 
controllability properties, structure properties and feedback lineariza- 
tion of respective control system, time-optimal relocation of particles. 
We obtain complete or partial answers to the posed questions; criteria 
and methods of geometric control theory are employed. In the present 
part I we consider nonperiodic multiparticle system. In the forthcoming 
Part II we address controllability issue for multiparticle system subject 
to periodic boundary conditions. That study requires an extension and 
refinement of known methods of geometric control. 
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1. Introduction 

Consider classical system of n interacting particles Vi, . . . ,Vn moving on 
a line with only neighboring particles involved in interaction. Let qk be the 
coordinate of the fc-th particle and pk - its impulse. 

We assume the potential of the interaction to be 

^(gi - 92) + ^>(g2 - gs) + • • • + ^>(gn-i - qn), 

where $ : M — > M is real analytic 0, bounded below function 
(1) lim ^{y) = +QO. 

The dynamics of such system of particles is described by the Hamiltonian 
system of equations with the Hamiltonian 



^ n n—1 

Hiq,p) = - ^pl + ^^qj - Qj+i). 



k=l j=l 



In fact most part of the results below would be valid for C°°-smooth but the 
reasoning in the real analytic case is less technically involved. 
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In coordinates qk,Pk the equations of system are 

.OH , , 

(2) Qk = TT- =Pk, k = l,...,n, 

dpk 

dH 

(3) Pk = = (piQk-i - Qk) - HQk - Qk+i), k = 2,...,n-l, 

Oqk 

(4) Pl = -4>{qi - q2), Pn = 4>{qn-l - qn) 

where (/> = is the derivative of It is natural to assume 

hm 0(y) = 0, 

the interaction decreases to zero, when the distance between particles tends 
to infinity. Under this additional assumption we can adapt the equations 
((4j) to the form jS]), introducing fictitious particles Vq and Vn on which we 
impose boundary conditions 

qo = -oo, qn+i = +00. 

Our main goal will be controlling the location and the momenta of the 
particles in situation where the control tools are limited, that is control are 
forces applied only to few particles of the system. 

We will study two cases: single forced multipartide system with a con- 
trolled force acting only on the particle Vi (or on Vn), double forced multi- 
particle system with controlled force applied to the particles Vi and Vn- 

It turns out that controlled multipartide system provides a model exam- 
ple for application of the methods of geometric control theory. Below we 
demonstrate their effectiveness for solution of various control-theoretic prob- 
lems for this model. In Section [2] start studying the Lie structure of the 
multipartide system, verifying full- dimensionality of its orbits and zero-time 
orbits and establishing its strong accessibility, whenever the system is con- 
trolled by single force applied to either Vi or Vn- We establish property of 
global controllability for double forced system in Section [3l The subsequent 
study of the Lie structure of single and of double forced multipartide systems 
Section |4] show that in many aspects these systems behave like linear ones. 
This is validated by result on their local feedback linearizability. The linear- 
like structure reveals again when we study in Section [5] time-optimal particle 
relocation problem by means of constrained controls. We prove that the cor- 
responding time-optimal controls are bang-bang, i.e. admit their values at 
extreme points of the rectangle which constrains the control parameters. The 
number of switchings between these extreme points is proved to be uniformly 
bounded for trajectories evolving on a fixed compact of state space. 

Another model, which we shall study in the forthcoming Part II of the 
publication, is multipartide system under periodic boundary conditions 

qo = Qn, qn+i = qi- 

It is known that the dynamics of the periodic and nonperiodic Toda lattices 
are completely different. Also the Lie structures of nonperiodic and periodic 
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controlled multiparticle systems differ substantially: the latter is far from 
being linear-like, what we establish for the nonperiodic system below. In 
Part II are going to study controllability properties of controlled periodic 
multiparticle system. 

2. Single-forced multiparticle system; Lie structure and 
accessibility property 

We introduce control ui{t) which is time- varying force applied to the par- 
ticle Vi of the multiparticle system. We obtain then for the (momentum) 
variable pi the equation 

(5) Pi = -4>{qi - q2) +u{t). 

The equations JS]) and the second equation in Q remain unchanged. 

The controlled multiparticle system is a particular case single-input control- 
affine system of the form 

(6) ± = fix) + g''{x)u, u G R, 

where x = {q,p) = {qi, . . . ,qn,Pi, ■ ■ ■ ,Pn) £ 1^^", the uncontrolled vector 
field / - the drift - and the controlled vector field g are defined as 

(7) ff'^ = / = jZPk^ - '^(91 - 12)^ + 

dpi f-^ dqk dpi 

k=l 

d d 
{Hqk~i - qk) - 4'{qk - qk+i)) ^ — ^Hqn-i 



k=2 



OPk OPn 



In this Section we start studying Lie structure of this single-input control- 
affine system by establishing accessibility property - full-dimensionality of its 
orbits and attainable sets. Exact definitions and needed criteria are provided 
in the following Subsection. 

2.1. Preliminaries. 

2.LL Vector fields, Lie brackets. Real analytic vector field in is an an- 
alytic map X ^ F{x) G T^R^ ~ M^. 

Any vector field F defines derivation F of the algebra of analytic functions 
on and vice versa. The commutator of two derivations is again 

a derivation, and the corresponding vector field is called the Lie bracket 
[F^,F'^] of F^,F'^. The operation [•, •] defines structure of Lie algebra in the 
space of vector fields. In coordinates it is calculated as 

[F^,F^] = DF'^F^ - DF^F'^, 

where DF stays for the Jacobian matrix of F. 

For a vector field F we consider the operator adF, which acts in the Lie 
algebra of vector fields in M^"-: adFF^ = [F,F^]. The iterations of this 
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operator are denoted ad-'F: ad-'FF^ = [F, ad-' ^FF^]. This operator is a 
derivation of the Lie algebra; it satisfies the Leibniz rule: 

ad/[ff, h] = [adfg, h] + [g, adfh] 

which is equivalent to the Jacobi identity of the Lie algebra. 

2.1.2. Lie envelope, zero-time ideal. Below we introduce the needed notions 
and formulate results for the class of control-affine systems; readers may 
consult [Hd] for the same material in more general context. 

Consider a control-affine system 

r 

(8) X = f{x) + G{x)u = f{x) + ^g''{x)ui, u = {ui, . . . ,Ur) e U, 

i=l 

where f,g^,...,g^ are real analytic vector fields on R-^. We assume the set 
U of control parameters to contain the origin OjRr in its interior. 

Let Lie{/, G} be the Lie algebra generated by f, g^ , . . . , g"^ , and I^{f, G} 
be its Lie ideal generated hy g^ , . . . ,g"^. We will call them the Lie envelope 
and zero-time ideal of the control system respectively. 

2.1.3. Orbits. Orbit Theorem. Substituting constant controls = . . . , ui) 
into the right-hand side of ([8]) we obtain vector fields /"^ which generate cor- 
responding flows 6*^-^" . Acting by the compositions 

(9) P = e*i^ o...oe*^-^ , ti,...,tjv G M, 

onto a given point x we get an orbit Ox of the control system jS]) from x. 
Requiring in addition ti + • • • + t^v = at the right-hand side of ([9]), we get 
zero-time orbit of the system. 

Acting by a diffeomorphism P*^ = e*"-^" (or by a composition ^ of 
such diffeomorphisms) onto zero-time orbit we obtain zero-time orbit 
0°, where y = P'^{x). 

The orbits and zero-time orbits possess regular structure. 

Theorem 2.1.3 (Orbit Theorem; Nagano-Stefan-Sussmann, |lj). An orbit Ox 
and zero-time orbit of the control system ^ are immersed submanifolds 
of M^. The tangent space to the orbit Ox at a point x G Ox coincides 
with the evaluation Liex{f,G} of the vector fields from Lie{/, G} at x; the 
tangent space to the zero-time orbit at a point x G coincides with the 
evaluation of the vector fields from T*^ at x. □ 

Corollary 2.1.3. The dimensions d{x) = dimLiCx, d^{x) = dimZ^ are con- 
stant along any orbit and zero-time orbit of the system respectively. Obvi- 
ously d°(x) < d{x) < (iO(x) -Fl. □ 
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2.1.4. Attainable sets. Accessibility property. Involving only those composi- 
tions dl]) , where tj are nonnegative, and acting by them on a given point x 
we obtain positive orbit or attainable set Ax of the system jS]) from x. If 
we pick T > and require in addition ii + • • • + i^v = T, or respectively, 
ii + ••• + %< T, then we obtain time-T (respectively time-< T) attainable 
set (respectively A^'^). 
Obviously Vx VT > 0: 

•^x -^x '^2; C Ox- 

Besides 

C e^f (O?) . 

It turns out that Ax and A^^ are 'massive' subsets of Ox and of e^^ (C'^) 
respectively. 

Theorem 2.1.4 (Krener). Attainable set A^"^ and possess nonvoid relative 
interiors in Ox and in e-^-^ (C'^)) respectively. The sets Ax,A'F are contained 
in the closures of their relative interiors. □ 

By virtue of Theorems 12.1.31 and 12.1.41 the sets A^'^ (respectively A^^) 
posses absolute interior whenever dimLie^ = A'' (respectively dimX^ = N). 

In these cases the control system ^ is said to possess accessibility property 
(respectively time-T accessibility property) from a point x. 

We will be interested in stronger property of global controllability. 

Definition 2.1.4. The system is globally controllable if Ax = ■ □ 

It is immediate to see that global controllability implies accessibility prop- 
erty. 

Proposition 2.1.4. 

Ax = ^ Ox = <^ dimLie^r = N ^ accessibility. □ 

The inverse implication is not valid; Ax is 'often' a proper subset of Ox- 
A sufficient criterion for coincidence of these two sets is discussed in Subsec- 
tion EH 

2.2. Lie envelope and accessibility property for single-forced multi- 
particle system. Coming back to the control system ©-([Tl) we are going 
to calculate dimension of its orbits and establish accessibility property. The 
results we obtain remain valid whenever control is applied to Vn instead of 

By virtue of the criteria formulated in the Subsubsections 12.1.41 and 12.1.31 
both properties can be derived from the following technical proposition. 

Proposition 2.2. The dimension dim equals 2n at each point x £ M^". □ 

This Proposition would follow immediately from the following Lemma, 
which provides more information on the Lie structure of ([6])-([7|. 
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Lemma 2.2. For each k > the distributions 



(10) 



X 



Span{{ad''fg''){x),k = 0,... 



m 



1}, AO = {0}, 



meet the relations 



(11) AfcSpan ^ A,^ 



with equalities in (fTT|) holding at a generic point of a zero-time orbit of the 
system ©-(El). □ 



Assuming validity of the conclusion of the Lemma we pick any point x G 
M^*^ and consider the corresponding zero-time orbit O^. At a generic point of 
this orbit D A^" and hence dimZ^ = 2n-dimensional. Then its (constant) 
dimension is 2n at each point of O^. 

An immediate corollary of the Proposition [22] is the accessibility property. 

Theorem 2.2. The multi-particle system, controlled by a single control 
(force), applied to either Vi or Vn, possesses for any T > 0, time-T ac- 
cessibility property, and the set of positions q and momenta p of the 
particles attainable from x = {p, q) in any time T > has an interior, which 
is dense in Aj.. □ 



A relevant question is what happens with accessibility when the controlled 
force is applied to an 'intermediate' particle Vj, j ^ 1, n. In this case the Lie 
structure is not so regular as the one defined by (fTOjl - lfTTI) . In fact for a generic 
4> the Lie rank is complete and the system possesses the accessibility property. 
Still for special choice of 4> the system may possess low-dimensional orbits and 
therefore lack the accessibility property. We provide corresponding example 
in the forthcoming Part II of the publication where we study this and other 
issues for multiparticle system periodic boundary conditions. 

Proof of Lemma \2.^ First, note that 



(12) 
(13) 

(14) 
(15) 



/ 1- 

J 1 o 

aqs 



+(l)'{qs - qs+i) 



d 



d 



dps dps+i 



f A 

dqi 



f A 

dps 
d 



_d_ 

dps 



d_ 

dqs' 

+ 



dps^i 
s = 2, . . . ,n — 1 



d 
dqn 



-(j)'{qn-i - qn) 



i- 


d 


\dpi 


dp2 


d 


d 


dpn-l 


dpn 
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Now we proceed by induction on k proving (fTTI) and verifying at the same 
time, that 

(16) ad^'^-i/^ = (-l)fc-Vfc-i(<7)7^ (mod A^'^-^), 

(17) ad^V-? = {-if-^lJik-M^ (mod K^^-^). 

where ^k{q) = 0^=1 4''{qj ~ Qj+i) ^iid we assume = 1 for /c = 0. 

For formulae ^ are valid, while formulae (fT6]l - (fT7l) are trivial. 

Let h?'^ be the distribution defined by (fTO]l with m = 2k. Our induction as- 
sumption is that (fT6]) and (fTTI) are valid for A"^^. According to (fTTI) the vector 
fields ad^fg^ with i < 2k can be represented as Yl^=i '^s{x)^ + (3s{x)-^ To 

and conclude by (fT2l) . (fT4l) that its values are contained in 
( d d , 

Span <—, — \j = l,...,k + l; 1 <s <k 
[dpj dqs 

On the other side by induction hypothesis 

^d'^-'fg = ^a.(x)^ +/3.(x)/-, 
^ dqs dps 

with Uk = {—1)^ fik{q), being nonvanishing at a generic point. 

The following equalities hold modulo A"^^ at chosen point of the orbit: 

(18) ad2V5=[/,ad2'=-V5] = 



evaluate [/, A^'^] we consider the Lie bracket /, Yl'l=i + (3s{x)-Mf- 



(-l)Vfc('Z) 



J 1 o 

oqk 



-l)'+Vfc(9)</''(% - %+i)Tr^ (mod A^^) 

OPk+l 



The factor (p'iqk — qk+i) at the right-hand side of (fTSjl may vanish at 

d 

dqk 



isolated points. Since by induction hypothesis the vector field ^ is tangent 



to the orbit we can shift our reference point along the trajectory of ^ 
(along the orbit) to a point where (j)'{qk — qk+i) becomes nonvanishing, while 
/ifc(g) and hence -fJ,k{q)4'' {qk - qk+i) = {-'^f Y[]t\ <t)' {qj - 9j+i) remain 
nonvanishing. We arrive to a point of the orbit where the formula (|16ll for 
ad^'^fg and the formula ([IIJ for A^''+^ is valid. 

The induction step from A^*^"^^ to A'^^'^'^ can be accomplished in a similar 
way. □ 

3. Global controllability of double forced multiparticle 

SYSTEM 

It is easy to see that single-forced multiparticle system is in general un- 
controllable, i.e. its attainable sets may not coincide with the whole state 
space. For example, if the particle Vn is not subject to controlled force, the 
initial value is positive, and (p{q) > (as it is in the case of Toda lattice). 
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then, given the nature of the interaction between particles we conclude from 
the corresponding equation pn = (j){qn-i — Qn) > 0, that is pn is increasing 
with time and can not attain values smaller than p^. 

In this Section and further on we will study the double-input case, in 
which controlled forces are applied to the particles Vi and Vn- 

3.1. Preliminaries: recurrency of the drift and controllability. For 

a control-affine system jS]) full dimensionality of its Lie envelope does not 
imply in general global controllability. An obstruction could be actuation 
of the vector field /. It can provoke a drift in certain direction which can 
not be compensated by any control. Now we will formulate conditions under 
which such compensation is possible. 

Let the vector field / in M.^ be complete. A point x € is non-wandering 
for / if for each its neighborhood Ux and each t > there exist x' G Ux, t' > t 
such that {x') G Ux- The vector field is recurrent if all the points of M.^ 
are non- wandering for /. 

Theorem due to B.Bonnard and C.Lobry ([3j,[Il]) allows to conclude Ax = 
MJ^ for the system ([8]) whenever dimLiCa; = A'' and the drift vector field is 
recurrent. 

Theorem 3.1.0. Let dimLie^ = A^ and / be recurrent. Then the system ([8|) 
is globally controllable. □ 

3.2. Global controllability of double forced multiparticle system. 

We consider the same multi-particle system described by equations ((2]),([3|) 
but now controlled by forces u,v applied to the particles Vi and Vn- The 
equations for the momenta of these particles become 

(19) pi = -(piqi - q2) +u, Pn = 4>{qn-i - Qn) + V, 

Adjoining these equation to the equations ([2])- ([3]) we obtain a particular kind 
of a double-input control-affine system of the form 

(20) X = fix) + g^{x)u + g^{x)v, = t^, ^ 



dpi dpn 

where / is defined by (jT]). 

Our goal is to prove global controllability of this system. To achieve it we 
will design the input u as a sum of a certain smooth feedback control and of 
an open loop control: 

dUf 



(21) u = Uf{qi) +Uo{t), Uf{q 
We choose the other input f to be a si 

(22) V = Vf{qn) 



dqi 

We choose the other input f to be a smooth feedback control: 

dVf 



dqn 

The conditions we impose on C/j, Vy : M ^ M are 
(23) lim Uf{q) = +oo, lim Vf{q) = +oo; 
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Uf,Vf are bounded below. 

Feeding the controls (f2T]) and ([22]l into the equations (fTOl) we obtain 

(24) pi = -(t){qi - q2) + Uf{qi) + Uo, Pn = HQu-i - Qn) + Vf{qn). 
Now ([2l)-(f3]l- (f24l) can be treated as a single-input system with scalar control 

Uo- 

Note that we have proceeded with a particular type of feedback transfor- 
mation; more comments on these transformations appear in Subsection 14.11 

The drift vector field for the transformed system ([2l)-(f3])- (f24l) is Hamilton- 
ian with the Hamiltonian function 

^ n n—1 

(25) Hj{q,p) = -Y^pI + J2 HQj " Qj+i) + Uf{qi) + Vf{qn). 

k=i j=i 

Hamiltonian vector fields are recurrent provided that the Lebesgue sets 
of the respective Hamiltonians functions are compact. Indeed the Lebesgue 
sets are invariant for Hamiltonian vector fields, whose flows are volume- 
preserving. By Poincare theorem all the trajectories of such flows must be 
recurrent. 

Therefore it suffices to prove the following technical lemma. 

Lemma 3.2. Level sets and Lebesgue sets of the modified Hamiltonian Hj 
are compact. □ 

Proof. Closedness of the level sets {{q,p)\ H{q,p) = c} and of the Lebesgue 
sets {{q,p)\ H{q,p) < c} is obvious by the continuity of Hj. It suffices to 
prove boundedness of the Lebesgue sets. 

Since *^(<?j — qj+i) + Uf{qi) + Vf{qn) is bounded below, say by 

—B {B >0), then the inequality Hf < c implies two constraints: 

\\pf <c + B /\^^qj- qj+i) + Ufiqi) + Vf{qn) < c. 
i=i 

Once again by lower boundedness of the functions ^, Uf, Vf and due to the 
growth conditions (fT]). ([23]) we conclude existence of a constant b such that 

rt— 1 

<^{qj - qj+i) +Uf{qi) + V/(g„) < c => 

i=i 

(26) ^ -qi<h I\qi-q2<h - g„ < 6 /\ g„ < 6. 

Summing the first k inequalities in the right-hand side of the implication 
([26]) we obtain —q^ < kb, or qk > —kb while summing n + 1 — k inequalities, 
starting from the last one, we obtain qk 1^ {n + 1 — k)b. □ 

Now we formulate the main result of this Section. 

Theorem 3.2. The double-forced multiparticle system (^-(3^-17^ is glob- 
ally controllable. □ 
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Proof. We invoke controls of the form (f2T]) - ([22]) or, in other words, aim at 
estabhshing controllabihty of the single-input system ([2l)-(f3]l- (f24ll controlled 
by Uo- 

The Hamiltonian drift vector field / corresponds to the Hamiltonian ([25]) 
with compact Lebesgue sets. By the aforesaid the drift vector field is recur- 
rent, and according to the Proposition 12.21 the evaluation of the Lie envelope 
Liex{/, 5^, 5^} is 2n-dimensional at every point x e M^". 

Then by Bonnard-Lobry theorem the single input control-affine system 
([2l)-(f3])- (f24l) is globally controllable, if the control parameter Uq is allowed to 
admit values of both signs: Uq & = [—^o,^o], > 0. 

This implies controllability of the double-input system (f2]l-([3]l- (fT9]) by 
means of controls of the form (f2T]) - (f22]l . □ 

Let us draw conclusions about the constraints, which can be imposed onto 
the values of the controls (f2T]l . ((221) in order to keep system controllable. The 
feedback components Uf,Vf of these controls are defined via the functions 
Uf,Vf, which can be chosen globally Lipschitzian with any Lipschitz constant 
Wo > in addition to ((23]) . Then the controls ((2T]) . ((22]) will fit the constraints 

Uf{t)+Uo{t) G [-2lOo,UJo], Vf{t) G [-Uo,UJo]- 

It is worth noting that choosing in addition Vj monotonously increasing we 
may constrain Vf by the interval [— Wo,0]. 
We conclude with a Proposition. 

Proposition 3.2. For each a; > the two-input system )fl))-f^)- j7g)) is glob- 
ally controllable by means of controls, which meet the constraints 

(27) u{t) G v{t) G [-t^,0]. 

For each pair of points x^,x^ in the state space of this system, there exist 
controls satisfying I127\) which steer the system from x^ to x^ in some time 
T{x°,x^,u;). □ 

Remark 3.1. We should mention the publication [15] where the authors 
studied controllability of Toda lattice (in Flaschka form) by means of n- 
dimensional controls 

di = 2bl + ui, d2 = 2{bl - bf), . . . ,d„_i = 2{bl_i - bl^2)An = -26^_i; 
(28) bi = 6i(a2 - ai) -\- Un+i, ■ ■ ■ 6„-i = 6n-i(a„ - a„_i) -\- U2n-i- 

Note that the controls . . . U2n-i appear in 'kinematic part' of the Toda 

equations and therefore can not be seen as forces. There is some contro- 
versy (possibly due to typos) in what regards the main result announced in 
|15| . The system ((28]) is not globally controllable on the contrary to what is 
claimed, at least because the variable a„ is decreasing according to ((28]) . 
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4. Feedback linearizability and constant rank 

In this Section we demonstrate that double forced multiparticle system 
possesses same local properties as controllable linear system, and in fact 
is locally equivalent to such a system. To do this we have to impose an 
additional regularity assumption onto the potential of interaction. 

Assumption 4.0. In Sections^^ji^we will assume the derivative </>'(•) of the 
interaction force 4> to be nonvanishing . 

Remark 4.1. This assumption is valid for Toda lattice. □ 

We start with recalling what are state-feedback transformations asnd go 
on with formulation of state-feedback linearizability criterion. 

4.1. State-feedback transformation and linearizability. State trans- 
formation is a local (at x") diffeomorphism P : x l—^ y of R^, which acts on 
the vector fields of a control-affine system ([8]) by differential P*. This results 
in a state transformation 

r 

(29) y = PJiy) + Y,P*9'{y)uj. 

of i]). 

Feedback transformation is a map 

v I— > M = a{x) + (3{x)v, (3{x) - nonsingular (r x r)-matrix, 

where a{x),(3{x) are defined in some neighborhood of x^. 

Such a transformation results in control system x = f{x) + G{x)v with 

(30) f{x) = f{x) + G{x)a{x), G{x) = G{x)f3{x). □ 

Definition 4.1.1 (state- feedback linearizability) . System is locally state-feedback 
linearizable if there exist a local feedback transformation ([301) and a local 
state transformation (f29l) such that 

(31) Pj{y) = Ay, P,G{y) = B, 

where A is A'^x A^-matrix, B = (6^ . . . 6'") and the vector fields 6* are constant. 

□ 

Remark 4.1.1. On the contrast to standard definition [HdS] we do not require 
local diffeomorphism P which appears in ([29]l and ([3T]) maps neighborhood 
of x^ onto a neighborhood of the origin in M^. Linearizability means state- 
feedback equivalence of the original system to a linear system defined in a 
neighborhood of some point y° G M^. □ 

We will invoke the following criterion of local state-feedback linearizabiity 
which is due to contributions of Jakubczyk-Respondek and Hunt-Sue-Meyer 

mm- 
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Theorem 4.1.1 ([8], [7]). Smooth control system x = f{x) + G{x)u = f{x) + 
X]5=i 5"' (^)^i oil A''- dimensional state space with r-dimensional control u = 
(ui, . . . ^Ur) is locally (at a point x^) state-feedback equivalent to a control- 
lable linear system, if and only if the vector distributions 

(32) X ^ = Span {adV^' l^, A; = 0, . . . , m - 1; j = 1, . . . , r} 
possess locally constant dimensions, are involutive, and dimA^o = n. □ 

4.2. State-feedback linearizability of double-forced multiparticle sys- 
tem. We are going to prove in this Subsection 

Theorem 4.2. The double-forced multi-particle system (fl|)-(f^)- f7g|) is locally 
state-feedback linearizable at each point. □ 

According to the Theorem 14.1.11 for establishing state-feedback lineariz- 
ability of the double-input control system ([2l)-(f3])- (fT9l) one has to verify in- 
volutivity of the distributions 

(33) X ^ A™ = Span {{ad^ fg''){x), k = 0,...,m-l} 

(34) X ^ = Span {(adV5'')(x), k = 0, . . . ,m - 1}. 

(35) A*" = A"" + H*". 

Involutivity and constancy of dimensions of these distributions are fulfilled 
by virtue of the following technical lemma. 

Lemma 4.2. For each k > 0: 

i) the distribution (|33ll is constant (does not depend on x); for m = 2k 
and m = 2/c + 1 

(36) 

K^>^ = Span |A,^|, = i,...,a, A2fc+i = A2/c + 5p,^ 

y dps dqs J [ opk+i J 

respectively; h9 = {0}. 

ii) the distribution (I34p is constant (does not depend on x); for m = 2k 
and m = 2k + 1 

(37) 

E'' = Span !^,^\s = n-k + l,...n],E'''+' = E'''+Span 

[ dps dqs J t opn-k J 

respectively; H° = {0}. □ 

Corollary 4.2. The distribution A"^ defined by l3^) is constant: 
Its evaluation at each point coincides with a coordinate subspace 

qi = ■■■ = Qi+r = 0,Pj = ■■■ = Pj+s = 0, 
and obviously is involutive. Besides A'^^ = M^", whenever 2fc > n. □ 

Proof of the Lemma. The items i) and ii) are proved in a similar way; 
both proofs follow the course of the proof of Lemma 12.21 An additional 
fact involved is that the factor (— l)'^ 11^=1 4''{Qj ~ Qj+i) which multiplies the 
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vector field ^ in (fT4l) is nonzero by Assumption 14.01 at the beginning of 
the Section, and therefore ([36]) and ([37ll are satisfied at all points. □ 

The conclusion follows from the Corollary 14.21 by application of the Theo- 
rem |4?TTT1 

4.3. Kronecker or controllability indices. One can draw conclusions on 
the structure of resulting linear control double-input system. For linear 
system Kronecker indices form full set of state feedback invariants of a linear 
system and determine its Brunovsky normal form. 

One can construct sort of Brunovsky normal form for the double forced 
multiparticle system; the Kronecker indices are now called controllability 
indices ([13|). It turns out that they depend on whether the number n of 
particles is even or odd. 

For even n = 2i the two controllability indices are equal: ki = k2 = n 
, while fci = n + 1, A:2 = n — 1 for n = 2^ — 1. Recall that the state is 
2n-dimensional. 

In both cases we define two sequences of functions by iterated directional 
derivation. 

For even n = 21 

(38) yi = qe, y2 = L/yi, • • • , Vn = ^/yn-i 

Zl = Qe+l, Z2 = LfZi, . . . , Zn = LfZn-i; 

for odd n = 2^ + 1 

(39) yi = qe+i, y2 = Lfyi, = L/y„ 

^1 = Qi+2, Z2 = LfZi, . . . , Zn-l = LfZn-2- 

Lemma 4.3. The map 

{qi,...,qn,Pi,...,Pn) ^ (yi,--- 

defined by (I38p forn = 2£ and by (I39p forn = 2£+l are local diffeomorphisms 
at each point of M^"; in both cases (yi, . . . , yn, zi, . . . , Zn) provide a system 
of local coordinates at each point. □ 

Theorem 4.3. For n even, the double-forced multi-particle system 
) f takes in local coordinates (|38l) the form 

(40) ijj = yj+i, j = l,...,n-l, ?/„ = Y{y, z) + X{y, z)u, ; 

Zj = Zj+i, j = l,...,n-l, Zn = Z{y,z) + ^{y,z)v; X{y, z)fi{y, z) 0. 

and after a feedback transformation u = Y{y,z) + X{y,z)u, v = Z{y,z) + 
fj,{y, z)v, the form 

(41) yl = u, z\ ' =v. 

For n odd, the double-forced multiparticle system takes in local coordinates 
(f39]l the form 

(42) ijj = yj+i, j = l,...,n; = Y{y, z) + a(y, z)u + P{y, z)v, 

Zj = Zj+i,j = l,...,n-2, Zn-i = Z{y,z) + j{y,z)v; a{y, z)-f{y, z) ^ 0. 
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and after a feedback transformation 

u = Y{y, z) + a{y, z)u + z)v, v = -f{y, z)v, 

the form 

(43) = n, 4""'^ =v.a 



Remark 4.2. The construction of the coordinates (|38]) . (|39]) and the hnearized 
forms (l4T]l . ([431) of the controlled multiparticle system are related to flatness 
of this system. In particular yi, zi cam be seen as flat outputs of the system. 
We do not follow this terminology further; addressing interested readers to 
the publications [5^, ^ and references therein. □ 



4.3.1. Proofs of Lemma \4.3\ and Theorem \4.3[ 

Proof of Lemma We provide a proof for the odd case n = 2£ + l. First 
check that 

(44) ^adV."^^ = { / + r =t + 1, ^ad^."^^ = 0, , + r < n + 1. 

/Ar\T ( 0, j + r<n — l, r ^ . 

(45) L , z,. = <^ ;! . ' L = 0, 7 + r < n - 1. 
^ ad'/s" 1/0, j + r = n-l, ad'/g- , j -r _ 



We prove the relations (|44l) for the coordinates by induction on r. Let 
r = 1; then according to the statement i) of Lemma l42] 

\d^fg^y^ = ^ad^ = 0, if J < 2£ + 1 = n, Lad"/,"yi ^ 
According to the statement ii) of the same Lemma ^g^(]J j-gvVi — 3 < 
2i+l = n. 

Assuming relations (l44l) to be valid for r < k, we use the identity L[j^g] = 
Lf o Lg — Lf o Lg to conclude for j + A; < n + 1 

We invoked the equality L^^j ^^^y^-i = which is valid by induction hypoth- 
esis. We conclude that L^^j ^^^yu = -L^^j^^^y^-i vanishes, \ij + k < n + 
and is different from Oifj + A; = n+l. Similar reasoning settles the induction 
passage for ^^^^i j^vVk- We proceed along the same lines in the proof of (l45ll . 

The differentials dyi, . . . , dyn+i, dzi, . . . , dzn-i are dual to linear indepen- 
dent system of the vector fields 

adVs", j = 0,...,n; ad7<?", i = 0,...,n-2. 

Hence ((39]) defines local coordinate system in the odd case. Proof for the 
even case is similar. □ 

Proof of Theorem Again the proofs of ([40]) and (l42]) are similar; we 
sketch the second one. 

First according to (l44l) 

Lguyj. = 0, Lgvyj. = 0, for r < n, LgvZg = 0, for s < n—1, LguZg = 0, for s < n—1. 
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Also -Lg^yn+1 + 0, LgvZn-i / 0. 

Basing on these identities we compute 

for j < n + 1. Also 

for s < n — 1. 

By the same computation 

iln+l = -^(/+g"M+g"i;)yn+l = L fU^+l + {Lg^yn+l)u + (Lgi>y„_|_i)u. 

= L fj^gu^j^gv^Zn-l = LfZn-1 + {Lgv Zn~l)v, 

where Lg^yn+i,LgvZn-i are nonvanishing functions of yi,Zj. □ 

4.4. Systems of constant rank. We will discuss another property of the 
control system ([2l)-(f3])- (fT9]) which follows from its state- feedback linearizabil- 
ity. It is called constancy of rank and has been introduced by A.Agrachev 
and S.A.Vakhrameev in |2j. 

Definition 4.4.1. For a control system x = f{x,u) consider input /end-point 
map SxO^T (with x^,T > being parameters) which puts into correspondence 
to each admissible control (input) u{-) the point x{T) of the corresponding 
trajectory of the control system starting at x'' at t = and driven by the 
control m(-). We denote the map £xO^Tiu{-)). The system x = f{x,u) is of 
constant rank if for each x^,T the rank (the differential) of £xO j'{u{-)) does 
not depend on u(-). □ 

The systems of constant rank inherit many properties of linear systems. 
It is known that state-feedback linearizable systems possess constant rank. 

Corollary 4.4. The controlled double forced multiparticle system (^-(3^- 
fTgj) possesses constant rank. □ 

5. Time-optimal control for double-forced multi-particle 

SYSTEM 

Let us consider a problem of time-optimal relocation of particles of the 
double- forced multiparticle system described by equations ([2l)-(f3])- (fT9l) with 
control parameters constrained by (f27l) . 

Problem 1. Given two points x = {q,p),x = {q,p) (two couples of initial 
and final values of positions and momenta of the particles) find a pair of 
admissible controls which steer the system /flj)-pj)-/ [7Pj) - ([27l) from x to x in 
a minimal time T > 0. □ 

Existence of an optimal control in a control-affine problem with bounded 
convex set of control parameters follows from Filippov's Theorem (0]). 

We will be interested in structure of optimal controls and start with formu- 
lation of Pontryagin maximum principle - necessary optimality condition for 
time optimal control problem. We limit ourselves to control-affine problems. 
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5.1. Time-optimal control, Pontryagin Maximum Principle, bang- 
bang extremals. Consider time-optimal control problem under boundary 
conditions 

(46) x{0) = X, x{T) = X, T ^ min. 

for control-affine system One seeks an admissible control, which steers 
the system ^ from x to a; in minimal time T. Along this Subsection the set 
U of control parameters in jS]) is assumed to be a compact convex polyhedron 
in M\ 

A first-order necessary condition for Li-local optimality of an admissible 
control u(-) for such problem is provided by Pontryagin Maximum Principle 
(see [H]). 

Theorem 5.1.1. Let pair {x{-),u{-)) be a minimizing control and correspond- 
ing trajectory for the time-optimal control problem ([8])- (|46|l . T being minimal 
time. Then there exists a non-zero absolutely continuous covector-function 
: R ^ {R^y, such that the pair {x(-),jp) satisfies Hamiltonian system 
with the Hamiltonian: 

(47) n(x, V', u) = (V, fix)) + G{x)u). 
In local coordinates this system takes form 

X = 9n/5?/'(x, -0, w(''")), tp = —dIl/dx{x^^l),u{T)). 

Besides the following conditions hold: 

i) Maximality Condition: 

(48) Il{x{t),^p{t),u{t)) = max{n(5(t),?/;(t),ii) : n G [/} a.e. on [0,T]; 

ii) Transversality Condition: 

n(x(r), Vi(T), n(T)) >0. □ 

The solutions of the equations of the Pontryagin Maximum Principle are 
called Pontryagin extremals, the corresponding controls u{-) are called ex- 
tremal controls. 

For any r € [0, T] maximum (H8l) of the control-affine Hamiltonian ([T7|l . is 
attained at some face of the polyhedron U . This face can be 0— dimensional, 
then extremal control takes its value at a vertex of the polyhedron, or s- 
dimensional (0 < s < r) and then the maximality condition does not deter- 
mine the value of extremal control uniquely. 

We call hang-hang the extremal controls for which the maximum is achieved 
at some vertices of the polyhedron [/ on a set of full measure in [0,T*]. 
Change of the value of control from one vertex to another one is called 
switching. The controls which take their values on faces of positive dimen- 
sions are called singular, it will turn out that such controls do not occur in 
our problem . 

A classical bang-bang result for linear time-optimal control problem with 
the dynamics x = Ax + Bu, u £ U the following theorem on structure of 
optimal controls has been proven by R.V.Gamkrelidze (see |14|). 
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Proposition 5.1.1. If for a directing vector V of any edge of the polyhedron 
U the vectors BV, ABV, . . . , A^~^ BV are linearly independent (genericity 
assumption) , then any control which satisfies the Pontryagin maximum prin- 
ciple (and in particular any optimal control) is piecewise constant, takes its 
values at the vertices of the polyhedron U and possesses finite number of 
switchings. □ 

iVon/mear control-affine time-optimal problem (I8]l- (l46l) do not resemble in 
general linear time-optimal problems and in particular the conclusion of the 
Proposition 15.1.11 does not hold for them generically. 

In the next Subsection we will prove that controls providing time-optimal 
relocation of particles (Problem 1) are bang-bang. 

5.2. Time-optimal relocation problem. Bang-bang properties of op- 
timal controls. The key additional feature of the control system dSJ-jS])- 
(fT9]) which allows to establish the bang-bang property is its constancy of 
rank and feedback linearizability (see Section |4|. 

Theorem 5.2. Optimal controls for the time-optimal relocation problem 
(Problem 1) are bang-bang and possess finite number of switchings. □ 

The proof is based on a criterion due to A.Agrachev and S.Vakhrameev 
(|2],[I3)- The criterion is formulated for the control-afRne time-optimal 
problem (f8]l- (l46l) and involves the following assumptions. 

Genericity Assumption. For a directing vector w of each edge of the 
polyhedron U and for all x G the vectors 

(49) Gw\^, ad fGw\^, . . . , (ad f)''-^Gw\^, 

are linearly independent. 

Bang-bang condition is satisfied for an edge w of the polyhedron U if for 
each point x S there exist smooth covector- functions x h->- a*(x) € W* 
defined in some neighborhood Q of x such that for any u £ U and for all 
i = 0,l,... 

i 

(50) [Gu, (ad fYGw] |^ = ^ (4(x),n)(ad fYGwl . □ 

i=i 

Theorem 5.2.1 ([Ej). Let ([8|) be analytic H system of constant rank, which 
satisfies the genericity assumption and the bang-bang condition for each 
edge of the polyhedron U of admissible control parameters. Then any time- 
optimal control of the problem ([8])- ([46]l is bang-bang with a finite number of 
switchings. □ 

To apply the criterion provided by this Theorem to Problem 1 we first note 
that the dynamics of multi-particle system is analytic. The control system 
([2l)-(f3])- (fT9l) is locally state-feedback linearizable and hence is of constant 
rank (equal to 2n). 



Actually less restrictive condition of finite-definiteness is needed. 
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The polyhedron U defined by (f27l) is a rectangle. The directing vectors 
Wu, Wv of its edges are parallel to the axes u and v. Substituting these vectors 
in place of w in ([491) we obtain two sequences of vector fields 

\A''— 1„M| . J „v\ /'„j f\„v\ f\N—l„v\ 

\xi 



(ad . . . , (ad D^'-^g^W, and g^^, (ad /)g^U, . . . , (ad f)''-^g- 



both of which are linearly independent according to Lemma [4.21 

The validity of the bang-bang condition (fSOll . verified for the rectangle U , 
can be derived from the equalities 

i 

(51) [gP, (ad fYg-] I = aj^{x){^d f^g'^ 

i=i 

where the symbols p and a coincide with either u or v. 

All these equalities can be verified in a similar way. We do it for p 
v,a = u, and distinguish the cases of even and odd i. 

According to the Lemma [42l , one gets for i = 2fc — 1: 

^ d ... 9 



(ad /)2'=-V = J]a.(x)— +/?,(x) 



s=l 



dqs dps 



As far as g'" = is constant vector field, which commutes with 
then 

k 

g\ (ad ff'-'g-] = ^ (Va.(x)) A + (V/3,(x)) A. 



s=l 



The values of this Lie bracket belong to A^'^ defined by (f36ll . According 
to Lemma 14.21 this Lie bracket can be represented as a linear combination 

E;=i&}(^)(ad/)^5" . 

The proof for i = 2k is obtained similarly. 

5.3. Uniform boundedness of the number of switchings. It is known 
that for a bang-bang control the number of switchings can be arbitrarily large 
and even infinite. In this subsection we wish to establish a stronger prop- 
erty of bang-bang optimal controls for time-optimal relocation problem. It 
guarantees uniform boundedness of the number of switchings for all optimal 
trajectories contained in some compact of M^". 

For control-affine system with single input the problem has been formu- 
lated and studied by A.J.Krener ([IQ]) and H.J.Sussmann 



Definition 5.3. Control problem possesses strong bang-bang property with 
bounds on the number of switchings, if for every compact set K and T > 
there exists an integer N{K, T) such that any time-optimal trajectory of 
time duration T, which connects two points x, x and is contained in K is 
bang-bang trajectory with at most A'" switchings. 
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Prom the aforesaid we already know that all optimal controls in time- 
optimal relocation problem are bang-bang. Technical lemma proved in [16] 
for single-input case can be adapted to the time-optimal problem ([2])-([3l)- (fT9]) 
with two inputs given the special Lie structure of the controlled multiparticle 
system and the fact that the set ([27|l of control parameters is a rectangle. 

Theorem 5.3. Time optimal particle relocation problem for double forced 
multiparticle system possesses strong bang-bang property with bound on the 
number of switchings. □ 

Proof. For the control system (l2Ql) the Hamiltonian of the Pontryagin max- 
imum principle takes form 

n n 

n(g,p, V'g, V^p, u,v) = ^ ijjg^pk + ^ i^p, {4>{qt-i - qe) - 4>{qe - qi+i)) + 

k=l l=\ 

(52) +iljp^u + ipp^v. 

According to ([52]l the bang-bang values of the controls calculated from 
the maximality condition (|48]) are defined by the sign of the "switching func- 
tions" a^it) = i;p,it) (t) = i;p„{t): 

uit) = ^osign(T"(i), vit) = Y (1 + signa"(i)) . 

Then it suffices to prove that extremal trajectories contained in any fixed 
compact K the number of zeros of the switching functions o""(t), cr'"{t) is 
bounded by a constant C{K). 

To this end we introduce the functions 

(53) al{t) = im, (ad/)V), cr'oit) = P ^ 
Evidently 

(54) a,^(t) = (V'(0,(ad/)'=+V(x(i))> + 
+n(V(t), [g\ (ad/) V](^(t))> + vim, (ad/) V](x(i))), 

and by ^ 

k k 

Kit) = ai^,{t) + u{t)aY^{t)a';{t) + J] v{t)a];{t)a<;{t) = 
j=i j=i 

k 

= Y,akj{t)a^{t) + a'^^^{t). 
i=i 

As far as {(ad/)^^"! /c = 0, . . . , 2n — 1} span i?^", the iterated Lie bracket 
{a.df)^^g^ can be represented as 

2n-l 

(55) (ad/)2V= ^ 7,(^)(ad/)V. 
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Setting = 2n — 1 in (f54|l and substituting ((55]) into its right-hand side we 
conclude 

2n-l 

(56) CT2n-l = Yl (^2n-l,jix)aPj. 

3=0 

Hence the functions cr^(i); k = 0, . . . ,2n — 1 satisfy the following quasi- 
triangular system of linear differential equations 

k 

(57) &'^{t) = Y,akj{t)<Jp{t) + a',^^{t), k = 0, . . . ,2n - 2, 

i=i 

completed by the equation ([56]) . 

We now apply to the quasitriangular system the following technical result 
due to H.J.Sussmann ([l6|); it establishes a bound on the number of zeros 
of the switching function. 

Proposition 5.3.1. Let absolute values of all the coefficients at the right-hand 
side of ((57l) - (f56l) be bounded by a constant A> 0. Then there exists positive 
T{A) such that on any time interval X of length < T the component ctq (0 
the solution of (f57|) either vanishes identically, or possesses at most 2n — 1 
zeros. □ 

The component o"o(t) can not vanish identically on an interval, as long as 
then all cr^{t) must vanish by virtue of (fSTll . which in its turn is impossible 
due to the definition (formula ((53]) ) of cr^{t) and Proposition 12.21 by which 
at each point dim Span {{adf)''gf\ k = 0, . . . ,2n — 1} = 2n. 

The conclusion of the Theorem 15.31 follows now from Lemma 15.3.11 by a 
standard reasoning provided in [TB]; an additional component needed for the 
proof is that the bound A for the coefficients (l57]) - ([56]) can be chosen the 
same for all extremal trajectories contained in a compact K C M^". 

□ 
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